THE CHAOS GAME ON AN ITERATED FUNCTION SYSTEM 
FROM A TOPOLOGICAL POINT OF VIEW 

MICHAEL F. BARNSLEY, KRZYSZTOF LESNIAK 
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Abstract. We investigate combinatorial issues relating to the use of random 
C^ ■ orbit approximations to the attractor of an iterated function system with the 

J^ ' aim of clarifying the role of the stochastic process during generation the orbit. 

A Baire category counterpart of almost sure convergence is presented; and a 
^•s , link between topological and probabilistic methods is observed. 

CO 

Q 



(N 



q 

co 

O 



>< 



ctf 



1. Introduction 



We prove that the chaos game, for all but a er-porous set of orbits, yields a set 
that intersects all of the fibres of an attractor A of a general iterated function sys- 
tem (IFS). The IFS may not be contractive and may possess multiple attractors. 
In [5] it was shown that, in proper metric spaces, attractors are limits of certain 
non-stationary stochastic chaos games; this generalized the canonical explanation, 
based on stationary stochastic processes, [13], of why the chaos game works to 
generate attractors. Here we present different results, based primarily in topol- 
ogy and category rather than in stochastic processes. Also, our results may have 
implications on how data strings are analyzed, as we explain next. 

An iterated function system F = (X, f a : a G E) is a finite set of discrete dy- 
namical systems f a : X — > X. If (o-k)kLi is a sequence in E then the corresponding 
chaos game orbit p] p. 2 and p. 91] of a point xo £ X is the sequence (xfc)fc°=o ^ e " 
fined iteratively by Xk = f ak (xk-i) for k = 1,2, .... The chaos game may be used 
(i) in computer graphics, to render pictures of fractals and other sets [21|4j|3T], and 
(ii) in data analysis to reveal patterns in long data strings such as DNA base pair 
sequences, see for example papers that cite [3D]. If the maps f a are contractions 
on a complete metric space X, and if the sequence {<Jk) k x L 1 ' IS suitably chaotic or 



random, then the tail of (xk)^L Q converges to the unique attractor of F. In ap- 



plications to computer graphics, long finite strings (ofc)£ =1 are used, say with L 
— 10 9 . In applications to genome analysis, if (<7k)k = i IS a l° n g finite sequence, say 
L = 2.9 x 10 9 for the number of base pairs in human DNA, and if the attractor of 
F is a simple geometrical object such as a square, then (xk)^ =0 may be plotted, 
yielding a "picture" of (cfc)fc=i- Such pictures may be used to identify patterns in 
(crfc)£ =1 , and used, for example, to distinguish different types of DNA, [5DJ. In the 
first case (i) a stochastic process is used to define the chaos game orbit (xk)k =0 
and to describe the attractor A of the IFS. In the second case (ii) a deterministic 
process, specified by a given data string, is used to define the chaos game orbit 
( x k)k=o'i fi° w this orbit sits in the attractor, that is, the relationship between the 
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deterministic orbit and the stochastic orbit, provides the pattern or signature of 
the string. Notice that there are two types of chaos game here: one describing an 
attractor, and the other describing a data string. Our results suggest the feasibility 
of data analysis (a) using topological concepts (b) using strongly-fibred IFSs. 

The type of IFS F that we consider is quite general: the only restrictions are 
that the underlying metric space X is complete and the functions f a : X — > X 
are continuous. In Section [2] we define an attractor, its basin of attraction, and 
chaos games. In Section [5] we also define the fibres of an attractor and describe 
how attractors are classified according to their fibre structure. The types of fibre 
structure of an attractor are minimal-fibred, strongly-fibred and point-fibred. In 
contrast to the situation for a contractive IFS, as in the classical Hutchinson theory, 
see [18], it is not generally possible to associate a continuous map from the code 
space S°° onto an attractor. Consequently, results concerning the behaviour of the 
chaos game cannot be inferred from analogous results, on the code space itself, by 
continuous projection onto the attractor. Nonetheless, in Section [3l we establish 
Theorem [TJ which says that the tail of any disjunctive chaos game orbit, starting 
from any point in the basin of an attractor, converges in the Hausdorff metric to a 
set Coo that is both contained in the attractor and contains a point belonging to 
each fibre of the attractor. This is achieved via a sequence of lemmas, similar to 
ones in [BJ, but replacing stochastic sequences by disjunctive ones, and lifting the 
requirement that X be proper. Theorem [T] allows us to prove in Section [4] that the 
chaos game, starting from any point in the basin of strongly-fibred attractor, yields 
the attractor, except for a set of strings that is small in the sense of Baire category; 
specifically Theorem |4] says that the set of strings for which the chaos game does 
not converge to the strongly-fibred attractor is cr-porous, which is stronger than 
first category. In Section [5] we define the notion of a disjunctive stochastic process, 
which generalizes the notion of a chain with complete connections [32j : then we 
prove, as a consequence the foregoing material, that Theorem [5] holds: namely, 
a chaos game produced by disjunctive stochastic process converges to a strongly- 
fibred attractor almost surely. Thus, we see that the stochastic version is a limiting 
consequence of combinatorics and topology, as it should be. 

Finally, in Section |6j we establish Theorem [6J - the Rapunzel Theorem - which 
illustrates the power of the disjunctiveness in the chaos game algorithm in the com- 
monly occuring situation where an IFS of homcomorphisms on a compact metric 
space possesses a unique point-fibred attractor A and a unique point-fibred repeller 
A*. This situation occurs for Mobius IFSs on the Riemann sphere 36 . Basically, 
the result says that if {o~k)^? =1 is a disjunctive sequence, then even when the point 
xq belongs to the dual repeller A* , the " usual/typical/almost always" event is that 
the chaos game orbit "escapes from the tower", the disjunctive sequence "lets down 
her hair" and the sequence of points in the chaos game orbit dances out of the 
clutches of the dual repeller. Why is this surprising? For a number of reasons, but 
mainly this: A* is the complement of the basin of attractor A, so it is not true that 
linife^oo F k ({x}) — A for icA*, and A* may have nonempty interior. 

2. Definitions 

Throughout, let (X,d) be a complete metric space with metric d. For b E X, 
C C X we denote 

d(b,C) := inf d(b,c), 

cec 
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and for B C X, e > 

N 6 B :={xeX :d{x,B) <e}. 

The Hausdorff distance between B, C C X is defined as 

h(B, C) := inf {r >0:Bc N r C, C C N r B}. 

Let JC{X) denote the set of nonempty compact subsets of X. Then (IC(X), h) is also 
a complete metric space, and may be referred to as a hyperspace (p1[2ll8l fT4lll7] V 
The system F = (X, / CT : a € £), comprising a finite set of continuous maps f a : 
X — >• X, is called an iterated function system (IFS) onX |]. Without risk of 
ambiguity we use the same notation F for the IFS and the associated Hutchinson 
operator 

F : K{X) -> /C(X) 3Bm F(B) = (J /„(£) - {/ CT (6) :*eZ,beB}. 

crGS 

This map is well-defined because the j a are continuous and finite unions of con- 
tinuous images of compacta are compacta. Furthermore, it is a basic fact that 
F : JC(X) — > IC(X) is continuous; a proof can be found in [5]. The fc-fold composi- 
tion of F is written as F k . 

Following [7] we say that A £ K.(X) is an attractor of the IFS F on X when 
there exists an open neighbourhood U(A) D A such that, in the metric space 
(IC(X),h), 

(2.1) F k (B) —> A, for U(A) D B G /C(X). 

fc— >C30 

The union ;B(A) of all open neighborhoods i7(A) such that (|2.1|l is true is called the 
basin of A. Since F : /C(X) — >• /C(X) is continuous it follows that ^4 is an invariant 
set for F, i.e. A — F(A). Clearly, A is the unique fixed point of F in the basin of 
A, i.e., if B = U ffes U(B) and 6(A) D B e K.(X), then B = A. 

The coordinate map ir : S°° — > K.(A) for A (w.r.t. F) is defined by 

oo 

for all p gE°°. The set A p is called a fibre of A. If A^ is a singleton for all p £ S°°, 
then A is said to be point-fibred. A is strongly-fibred means that if U is an 
open cover of A and U eil then there is p eS°° such that A p C U. For reasons 
related to a more general notion of " attractor" , all attractors of IFSs are said to 
be minimally-fibred. Strongly-fibred is weaker than point-fibred which is weaker 
than the situation where A is the attractor of a contractive IFSs. Classification of 
attractors according their fibration is discussed in 28, Chapter 4]. 

Let (cti, cr 2 , . . .) £ S°°. The associated orbit of x E U(A) under F is the sequence 
( x k)T=o defined by 

(2 2) ( X ° £ U ^' 

If (01,02, . . .) is chosen according to some stochastic process, then (xfe)^ is re- 
ferred to as a random orbit. More generally, such orbits are referred to as chaos 
game orbits, see pQ and [33], for example. 

We use the notation f w := f ai °- ■ -°fa k for a finite word w — (ci, . . .,Ofc) G S fe , 
so that Xk = fw(%o)- The concatenation of two words u = (vi,...,v m ) G S m 
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and w = ((7i, . . .,CTfc) G E fc is m» := (ui, . . .,v m ,ai, . . -,crk) £ E m+fc . Notice that 
/«tu = fu°fw- We may omit the parentheses and commas; for example u = vi. ■ .v m . 

3. Main Idea 

Throughout this section let F — (X, f a : a G S) be an IFS with attractor 
A G /C(X) and basin B(A). Let (xfc)/c^o denote the orbit of xo under F, associated 
with (o-i,cr 2 , ...) e S°°. 

The following observation lies at the heart of this investigation. It is hidden in 
[B]; compare also with [351 Theorem 12.8.2]. 

Lemma 1. Given xq € B{A), we have y G A if and only if, for given e > there 
exists a natural number m and a word w = (<7 m , <7 m _i, . . ., o~i) 6 S m smc/i i/iai 
d(fw{x ),y) < e. 

Proof. Suppose y £ A and let e > be given. The definition of attractor implies 
that there exists an iteration m such that ft.(-F m ({a;o}), A) < £, and in particular 

y€AcN s F m ({x }). 
But 

^F m (W) = ^e |J U({xo})= |J iV e /™({a!o}). 

It follows that y G ^/^{cco}) for some to G S m . It follows that there exists a 
word w = (<7 TO , cr m _i, . . ., <7i) 6 S m such that d(f w (x ), y) < e. 

Conversely, suppose y is such that, given e > 0, there exists a natural number 
m and a sequence w = (<7 m ,<r m _i, . . .,cti) € S m with d(f w (xo),y) < e. It follows 
that d(y, F m ({x })) < e. It follows that y e lim™^ F m {{x }) = A. D 

For a G S°°, £ £ X, k G {1, 2, ...}, define 

Xfc :=x fc (a;o,CT) := f ak o .... o/ ffl (x ). 
For all if = 0,1,2,... define 



Ck := CifCxco - ) := [J {x fc }. 

k=K 

It is straightfoward to prove that {xt }^L is totally bounded; consequently {Ck }k=o 
is a decreasing (nested) sequence of nonempty compact sets that converges in the 
Hausdorff metric to a unique nonempty compact limit 

oo 

Coo := Cooixo,^) := |) C K . 

K=\ 

Lemma 2. If A is an attractor of F , B(A) is the basin of A, xq G B(A) and 
a G S°°, then 

C'oo{x ,a) G A. 

Proof. First, it follows from Lemma Q] that a G A if, and only if, there is an infinite 
subsequence {ki}'^l 1 of {k}^ =1 and p^'G^ 1 for I = 0, 1, 2, ..., such that 



converges to a, namely 



{/„(*!) °-°./>i>(a:o)}£i 



lim / ( *,) o ... o / (fcl) ({xq}) = a. 

I— tOC Phi ^fci 
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Second, note that if c £ Coo, then there is an infinite subsequence {k m } m=1 of 
{k}^L 1 such that {fa km o .... o / CTl (xo)}^ =0 converges to c. By the first observation, 
on choosing p^ = u^ l ...cj\ for I = 1,2, ..., we obtain c <G A. □ 

The following lemma is perhaps suprising. 

Lemma 3. Let A be an attractor of F, let 13(A) be the basin of A, let a £ S°° and 

let x £ B(A). We have 

F(Coo(a;o,cr)) := (J /(CoofaojC)) 3 Coo(zo,cr) 

Proof. We have 

F(CK(aro,c7))= |J /(CxOco,*)) 

/6-F 



= U/(U {/^° ••■•%! (*0)}) 

oo 
= U U {f O fa k O .... O f ai ( Xo )} 
feFk=K 

D C K +i(x a ,a) 

We know that F : K,(X) — ¥ K,(X) is continuous. Taking limits of decreasing 
sequences, we obtain 

F(Coo(xo,(t)) D Coo(x ,ct). 

D 

In summary, so far, we have that for all xo £ B(A), for all a £ E°°, 

Coo{xQ,a) £ F(Coo(xo,o-)) £ A. 

Lemma 4. Let A be an attractor of F, let B(A) be the basin of A, let xq £ B(A), 
a £ E°°, and let di6 2 ...0p £ S p for some P £ {1, 2, ...}. 7/ 

%+1-%+p —0i9 2 ...9 P 

for infinitely many distinct positive integers M, then 

fe P o ... o/ ei (C 00 (xo,cr))nC , oc (x ,CT) ^ 0. 

Proof. Let P = 1. We have, for all positive integers K and L, 

(3.1) 



hi( C K{Xo,(T)) nC K +L(xo,cr) = f 6l ( (J {/ CTfe O....o/ (7l (x )})n( (J {f„ k o....o/ ffl (x )}) 

fc=K k=K+L 



( (J {/«i ° /'* ° •- ° /^N)}) n ( |J W k o .... o f ai ( X0 )}) 



k=K k=K+L 



3 IJ {/»» ° ■•••%! (*0)})- 

fce{K+L,...} 

S.t.CTk— &1 
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The last expression is nonempty because o~k =9\ for infinitely many values of k. It 
follows that {fe 1 (Ck) H Ck+l}°l = i is a decreasing sequence of nonempty compact 
sets. It converges to a nonempty compact set and it converges to /e 1 (Cjf) (~l C^ so 

f 6l (c K ) n<W0 

for all X = 1,2,.... But now {/^ (Cr-) D Coo}^ =1 is a decreasing sequence of 
nonempty sets and it converges to 

This proves the result for the case P = 1. For the general case, replace fg 1 by 
fg p o ... o / 6l and adjust the expressions in (13.11) accordingly. □ 

We say that the infinite word a — (a%, o~2, . . .) £ E°° is disjunctive ( |11[ 155] ) if 
it contains all possible finite words i.e. 

V m Vu, e s m 3j Vj=l ) ... im 0"(j_i)+J = W;. 

In fact any finite word appears in a disjunctive sequence of symbols infinitely 
often, because it reappears as part of longer and longer words. 

Proposition 1. The sequence (a n )^L 1 *= ^°° * s disjunctive if and only if 

(3-2) V n , m V( TljT2] ... )Tm )g£m 3fe>„ Vj=l J ... )TO Tl = (Tk + l- 

Example 1. (Champernowne sequence). Let us write down finite words over the 
alphabet E: first the one-letter words, second two-letter words etc. An infinite word 
made by concatenating this list creates a disjunctive sequence of symbols in E°°, 
a Champernowne sequence. Note that all normal sequences are disjunctive but 
the converse is not true. 

Applications of disjunctive sequences in complexity, automata theory and num- 
ber theory are described in the papers cited in |11) . 

What does disjunctiveness give us? Let Sf denote the semigroup of continuous 
functions from X to itself, generated by F. That is 

S F := {f ai o ... o f ak : k £ {1, 2, ...} , a x ...o- k £ E fc } 

where the semigroup operation is function composition. 

Lemma 5. Let A be an attractor of F, let 13(A) be the basin of A, let xq £ B, and 
let a £ E°° be disjunctive. If f £ Sf, then 

/(C 00 (x ,CT))nC 00 (a;o,cr) ^ 0. 

Proof. This is an immmediate consequence of Lemma HI combined with disjunctive- 
ness of u. □ 

Theorem 1. Let A be an attractor of F, let B(A) be the basin of A, let xq £ B(A) 
and let a £ E°° be disjunctive. The set C^xo^a) intersects every fibre of A; that 
is, 

A p nC7 oo (a; ,cr) ^0 
for all pGS°°. 
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Proof. We have 



C^ n A p = Coo n lim f Pl o .... o / (A) 

K—too 



Coo H P| / Pl o .... o f PK (A) because decreasing, 



if=i 



P| (Coo n f Pl o .... o f PK (A)) easily checked, 



K"=l 

But, since Coo C A by Lemma [21 we have 

Coo n f pi o .... o f PK (A) d Coo n / P1 o .... o / PA .(Coo) 

for all K. Also, by Lemma [3] and the assumption that a is disjunctive, we have 

Coonf pl o....of PK (Coo)^9 

for all K. It follows that {Coo ("1 f Pl o .... o / Pic (A)} is a decreasing (nested) sequence 
of non-empty compact sets. It follows that 

oo 

Coo n A p = Coo n p / P1 o .... o / PiC (A) ^ 0. 

_fs"=l 

□ 

This says that, given any fibre A p of an attractor, there exists p £ A p and a 
subsequence of {xk} that converges to p. 

Corollary 1. Let A be an attractor of F, let B be the basin of A, let xo £ 13(A) 
and let a £ E°° 6e disjunctive. If A is strongly-fibred, then 

Coo(x ,cr) = A. 

That is, the tails of the random orbit 

(3.3) {x n : n > p} — ► A 

p— >QO 

converge to the attractor with respect to the Hausdorff distance, and 



oo oo 



(3.4) A = P |J {*„}. 

p— 1 n— p 

Proof. Let W be a cover by balls of radius epsilon. Since A is strongly-fibred, for 
each U E U there is p £ S°° such that A p C [7. Hence, a point of Coo^cbc) 
lies in each U € U, by Theorem [TJ It readily follows that C o(a;oi ') 3 ^- But 
Coo(xv,cr) <Z A;\\enceCoo(xoiO-) = A. □ 

Note that Theorem Q] is stronger than Corollary [T] 

Here we digress slightly from our main themes to reflect on the name "chaos 
game" , since the process underlying the chaos game algorithm can be purely deter- 
ministic and does not need to be related in any way to ergodicity (e.g. Example [3]). 
In dynamical systems theory the "furthest island" of stability is usually considered 
to be almost periodic behaviour, after stationary, periodic and quasi-periodic; be- 
yond quasi-periodicity is the "ocean" of chaos. Following [30] we recall that an 
infinite sequence of symbols <; is almost periodic (or uniformly recursive) if, given 
any finite word r that occurs in <; infinitely often we can associate a positive integer 
m such that any segment in <; of length m contains r as a substring. Obviously 
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a disjunctive sequence cannot be almost periodic. Therefore the descriptive term 
"chaos game" retains its interpretation. 

4. Categorial analysis 
Subset ^ C M of a metric space M is called porous when 

(4.1) 3 <A'<1 3 ro>0 V^ G * V <r<r ^v£M N\> r {v} C N r {lp} \ *. 

A countable union of porous sets is said to be cr-porous. A subset of a cr-porous 
set is cr-porous. 

Note that every cr-porous set is of the first Baire category and that this is a proper 
inclusion. Moreover every cr-porous subset of euclidean space has null Lebesgue 
measure. In general metric spaces one can also relate the ideal of porous sets to 
the ideal of null sets under suitable assumptions. We quote such a result next and 
then show its natural application in Example 2] 

Theorem 2 ([55] Propositions 3.5 & 3.3). Let // be the completion of a Borel reg- 
ular probability measure on a separable metric space M which satisfies the doubling 
condition 

(4.2) 3 ro>c>0 V</,6M V <r<r /J,(N 2r {%()}) < C • ^{N r {-ip}). 

If^ffCM is a -porous set, then it is null i-J.(^) = 0. 

We remark that the regularity assumption is superfluous since probabilistic Borel 
measures on metric spaces are always regular ( [9 Theorem 1.1) and completion adds 
only subsets of null sets. Fulfilling doubling condition everywhere implies that the 
measure is strictly positive (i.e., nonempty open sets are have positive measure); 
thus the support of the measure is the whole space. 

More on porosity can be found in [37j [29] . The book [24] uses porosity to study 
generics in optimization problems (cf. [TO])- Results relating to porosity in fractal 
geometry and analysis can be found for example in |121 125] . 

The following criterion will be useful. 

Proposition 2. If^>C M satisfies 

(4.3) 3 <A<i \fy e * V„>i 3 veM N x . 2 -n{v} C N 2 -n{vp} \ *, 
then ^r is porous. 

Proof. Choose ro := 1 and associate with < r < r$ the number n > 1 in such a 
way that 

2~ n < r < 2 ■ 2- n . 
(Namely n :— entier[log 2 (r -1 )] + 1). 

From (|4.3p there exist appropriate < A < 1 and v € M. Scale A' :— -| verifies 
63): 

Ny r {v} C N X2 - n {v} C N 2 -n{i>} \ * C N r {i>} \ v[r. 

□ 

Now we recall that the Cantor space (S°°, g) is the set of infinite words over 
alphabet E equipped with the Baire metric 

e((^i>4=i):=2~ min{l: ^ } 

for {(Ji)^, (wO^i G s °° (conveniently 2~ rain0 := 0). Note that this space (E°°, g) 
may be referred to as code space in fractal geometry settings. 
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The topology of the Cantor space is just the Tikhonov product of the discrete 
alphabet E and so it is compact. But the Baire metric obeys ultrametric triangle 
inequality; this provides a tree structure in the space (compare also Konig's lemma 
on trees). The Cantor space appears among others in automata theory (e.g., |llj 
and references therein) and symbolic dynamics ([U[2]). 

For future reference we note that balls in the Baire metric are cylinders 

(4.4) V„>i V 2 - ( „ + i) <r ,< 2 -„ V^^^gsoo N r {i>} = {V>i} x . . . x {ip n } x E°°. 

For t = (n, . . ., r m ) G E m and p > 1 denote 

*(r,p) := {{^)T=i e S°° : 3 fc > p V i= i,..., m 77 = <7 (fc _i )+ j}, 

the set of words that do not contain the subword r from the p-th position onwards. 

Lemma 6. The set ty(r,p), as a subset of the code space (E 00 , g), is a Borel set 
and porous. 

Proof. To simplify notation vp := ^(r, p) and n := n + p given n > 1. 
Let ip = (V>i)£i £ *• We investigate iV 2 -»{^} \ *. 
Define for z > 1 

^», « < ", 

^"(z— n) mod m+1) Z ^ 71. 

Of course u := (fj)^! £ E°° \ <£. Moreover ?j G 7V 2 -„ {?/;}, because 

g(v, </>) < 2"" < 2-". 

Consider <r = (ci)™^ G E°° close enough to v, namely 

q($,v) <2-( 2m +P)-2-". 

Then Ui = v% for i < (2m + p) + n. So 

p<h + m<h + m + l<...<n + m + (m — 1) < 2m + p + n 

and thus aa+m+l-i = T i f° r ' = 1,2,..., to, which in turn means that <; $ ^>. 
Additionally 

e(?,V) < e(c,w) + e(«,V0 < 2" 1 • 2-" + 2- 1 • 2~" = 2-", 

which means <j G N 2 -n{ip}. Altogether 

N x . 2 - n {v}cN 2 - n {ip}\V, 

if we put A := 2~( 2m+p K Therefore ^ is porous subject to condition (|4.3j) . 
The complement 

S°° \ * = U EP+f^ 1 ) x {n} x ... x {r m } x E°° = 
fc>i 

= U U A 2 -(p+ fc -i+ m) {7r -r} 
fc>i 7 resp+ fc - 1 

is a countable union of open balls due to (14.41) , hence ^> is Borel. □ 

Theorem 3. Sequences which are not disjunctive form a Borel a-porous set D' C 
E°° w.r.t. the Baire metric. 
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Proof. We have 

D' = {(ui)£i e E°° : (oj)£i does not obey condition ([3^])} = 

= U U U *(*■.*)• 

p>l m>l r£S™ 

Since our union is countable, it is enough to remind that the sets $(r,p) are porous 
according to Lemma [S] □ 

We are ready to prove the main theorem of this section. 

Theorem 4. The set of sequences (o~ n )'^L 1 S E°°, which fail to generate a random 
orbit that yields the strongly-fibred attractor of the IFS F via (|3 .3[) and (|3.4p is 
a -porous in (£°°,£>). 

Proof. The set of faulty sequences is a subset of D' in Theorem [3l D 

5. Probabilistic analysis 

Let Z n : (S,&,Pr) — > E, n = 1,2, .. ., be a sequence of random variables on 
a probability space (S, 6,Pr), where 6 is a cr-algebra of events in S, and Pr : 
© — > [0, 1] probability measure. This stochastic process generates "truely" random 
sequences (a±, o~2, ■ ■ •) € S°° i.e. er„ = Z n (s) if the event seS happens at the n-th 
stage. 

We define the stochastic process (Z n ) n >i to be disjunctive when 

V m >i V TeSm Pr (Z(„_ 1)+/ = r/, / = 1, . . ., m, for some n) = 1; 

that is, each finite word appears in the outcome with probability 1. 

In fact all words almost surely appear infinitely often. But an even stronger 
assertion is true. 

Proposition 3. A disjunctive stochastic process (Z n )n>\ with values in E generates 
a disjunctive sequence (o' n ) < ^' =l £ E°° as its outcome with probability 1. 

Proof. Denote for u <G E m 

E(u) := {{Z {n _ 1)+1 , . . ., Z (n _ 1)+m ) = u for some n}. 

Define inductively "/(p) to be the finite Champernowne word (Example[l| consisting 
of all finite words over E with length at most p > 1, and such that "f(p + 1) is just 
j(j>) with attached at its end all finite words of length p + 1. Thus the sequence 
of events E(-y(p)), p — 1,2,..., is descending. Moreover by disjunctiveness of the 
process Pr(E( r y{p))) — 1, so 



>w 



Pr f| E(-y(p)) 
The event 

n n «(«) 

m>l ue£ m 

describes the appearance of a disjunctive sequence as an outcome. Its probability 
equals 1, because 

f) f) E(u) D E(n(p)). 

□ 
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Example 2. (Bernoulli scheme; [I],). Suppose (Z n ) n >x is the sequence of indepen- 
dent random variables is distributed according to 

(5.1) 3„>o V„>i V ffeS Pr(Z n = a) > a. 

An example is the classical Bernoulli scheme with outcomes in S. Then (Z n ) n >i 
is disjunctive process. This follows from the Borel-Cantelli lemma (e.g. the classic 
Example on p. 37 after Theorem 2.2.3 in [21] ). 

For Bernoulli scheme one could alternatively apply Theorem 2.3 (item 6) from 
|11) which says that the set of nondisjunctive sequences is null with respect to the 
Bernoulli product measure. This follows as corollary from combination of Theo- 
rems^ and\M See ExampleU\ below for a more general case. 

Although ergodic stochastic processes are useful in engineering applications (e.g. 
p~5l [TBI [34] ) they might be too weak for reliable simulations in probabilistic algo- 
rithms like the chaos game. (In particular, pseudorandom number generators that 
pass a battery of statistical tests may fail to generate an attractor). 

Example 3. (Ergodicity is not enough; [23 Example 1.8.1). Let (Z n ) n >i be the 
homogeneous Markov chain with states in E := {1,2} such that 

V ffeS Pr(Zi = a) = -, 

V„> 2 Pr(Z„ = 1 1 Z n _ x = 2) = 1, 

V„>2 V CTe s Pr(Zn = a \ Z n -\ = 1) = -. 

(Note that we put also condition on initial distribution of the chain). It is ergodic 
(even strongly mixing as the square of its transition matrix has positive entries; 
e.o.|34] Prop. 1. 2. 10). Moreover our chain occupies all states almost surely: 

V CT gx; Vx(Z n = a for infinitely many n) = 1. 

Nevertheless the word "22 " is forbidden: 

Pr(Z n — 2, Z n+ i — 2 for some n) = 0, 

i.e. the process lacks disjunctiveness (comp. with discussion in [34 chap. 1-4)- 

In relation with ExampleVAit is not hard to see that a homogeneous finite Markov 
chain (with strictly positive initial distribution) is disjunctive if and only if its tran- 
sition matrix has positive entries. 

Example 4. (Chain with complete connections; [6],). Let (Z n ) n >i be a sequence of 
random variables with conditional marginal distributions 

(5.2) 3 Q>0 V„>i V CTli ... i(Tree sPr(Z„ = a n \ Z„_i = <7 n _i, . . ., Z x = ax) > a, 

and initial distribution 

Pr(Zi = o-i) > a. 

Sometimes it is called chain with complete connections and significantly gen- 
eralizes usual Markov chain (\W\). We shall indirectly prove that such minorized 
chains are disjunctive processes. 

Define on (S°° , g) probabilistic measure /i to be the completion of the joint dis- 
tribution of the process (Z n ) n >i: 

M (H):=Pr((Z 1 ,£ 2 ,...)eH) 
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for Borel subsets H C S°° (comp. |34j Theorem 1.1.2 or |15j Section 2.1 ana 
Chapter 3). By description of balls given in (|4.4p 

/x(iV r {?}) = Pr(Zi = cti, . . .,Z„ = cr n ) 

for radii r G (2"(™ +1 ), 2"™] , n > 1, anrf centers at <r = (<n, . . .,a n , . . .) G S°°. 

TTie measure \x obeys doubling condition. Indeed assume now 2r G (2~( n+l \ 2 _ ™1 
and calculate 

n{N 2r {^}) = Pr(Zi = <n,...,Z n = ffn) = 

Pr(Zi = &!,... ,Z n+ i = o-n+i) 1 ,, T { -.s 



Pr(Z„+i = c n+ i | Z„ = (T n , . . ., Zi = CTi ) a 

where the inequality comes from (|5.2I) . 

Therefore we can apply Theorem^ and Theorem\^to find out that nondisjunctive 
sequences form Borel \i-null set, so the chain generates disjunctive sequence almost 
surely. 

We finalize this section by giving its main result, which follows directly from 
Theorem [T] via Proposition [3l 

Theorem 5. Let A be a strongly-fibred attractor of the IFS F = (X, f a : a G £). If 
the stochastic process Z n : (S, &, Pr) — > E, n = 1, 2, . . ., generating (cr n )^Li G S°° is 
disjunctive, then Q3.3P and (|3.4p in t/ie statement of Corollary{l\hold with probability 
1. 

6. The Rapunzel Theorem 

Let -F = (X, f a : a G S) be an IFS of homeomorphisms acting on a compact 
metric space X. Let 

be the corresponding dual IFS. Let A be an attractor of F, and let B(A) denote the 
basin of A. Then the set A* := X\B(A) is called the dual repeller and (A, A*) is 
called an attractor /repeller pair. We suppose here that A* is an attractor of F*. 
It is readily proved that the basin B(A*) of A* (with respect to F*) is B(A*) = X\A. 
Note that £>(A) = X\A*. We furthermore suppose that A is point-fibred with 
respect to F and A* is point-fibred with respect to F*, see [551 Chapter 4]. This 
means that there exist continuous maps 

tt f : E°° -> A and tt f « : £°° -> A* 

that are well-defined for q = ci...^... G S°° by 

7t_f(?) = lim f ai o ...f ak (x), x G B, 

fe— >oo 

tt f .(c) = lim /- 1 o .../-^(y), y G B* , 

where the limits are independent of x and y. Moreover we have for all <r G S°° 

(6.1) MS®) = tfiM*)) and n F *(S(<;)) = / CTl (tt f * (?)) 

where 5 : E°° — > S°° is the shift map, namely the continuous mapping defined by 

S(q) = (72(73... for all q — CT1CT2C73... G S°°. 

In general, an IFS of homeomorphisms can have many attractor/repeller pairs. 
Here we are considering only the situation where F has exactly one attractor. 
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Our terminology and ideas derive from |26] and [27]. However, there is a crucial 
difference in nomenclature, because what McGehee calls an "attractor" we would 
call a " Conley attractor" . 

Theorem 6. Let F be an IFS of homeomorphisms with a unique point-fibred at- 
tractor A and point-fibred dual repeller A* . Let ^ be a disjunctive sequence. Then 
there is a set of points X' C X such that (i) X\X' is a -porous; (ii) the chaos game 
orbit generated by F,x,<; yields A for all x G X' ; (Hi) the dual chaos game orbit 
generated by F*,X,$ yields A* for all x G X' . 

Proof. Let x G X. If x = 7rp» (V) then, given any open neighbourhood 0(x) of x 
there is an open set O(x') C 0(x)\{x} and, obviously, every point y in O(x') either 
belongs to the basin B(A) of A, in which case its orbit yields A, or y G A* and has 
a compact set of addresses Wpl{y) that does not include <;. Let K be the highest 
index of agreement between <^ and any member of TTpl(y). Then, using equation 
(|6.ip . we must have 



f£ +1 ° f£ o f~l_ x o .../-l(y) G B(A), 

(for otherwise there would have been one higher level of agreement) which tells us 
(using disjunctiveness) that the chaos game orbit generated by F, y, s yields A. It 
follows that the set of points x, denoted X", for which the chaos game generated 
by F,x,<; yields A has a cr-porous complement X\X". Similarly for x in the set 
of points Y, for which the chaos game generated by F* ,x,q yields A* has also a 
<7-porous complement. The proof is completed by choosing X 1 = X" DY. □ 
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